Multiple Parameter Selection for LS-SVM Using Smooth Leave-One-Out Error
نویسندگان
چکیده
In least squares support vector (LS-SVM), the key challenge lies in the selection of free parameters such as kernel parameters and tradeoff parameter. However, when a large number of free parameters are involved in LS-SVM, the commonly used grid search method for model selection is intractable. In this paper, SLOO-MPS is proposed for tuning multiple parameters for LS-SVM to overcome this problem. This method is based on optimizing the smooth leaveone-out error via a gradient descent algorithm and feasible to compute. Extensive empirical comparisons confirm the feasibility and validation of the SLOO-MPS.
منابع مشابه
Radius-Margin Bound on the Leave-One-Out Error of a M-SVM
Using a support vector machine (SVM) requires to set the values of two types of hyperparameters: the soft margin parameter C and the parameters of the kernel. To perform this model selection task, the method of choice is cross-validation. Its leave-one-out variant is known to produce an estimator of the generalization error which is almost unbiased. Its major drawback rests in its time requirem...
متن کاملA Quadratic Loss Multi-Class SVM
Using a support vector machine requires to set two types of hyperparameters: the soft margin parameter C and the parameters of the kernel. To perform this model selection task, the method of choice is cross-validation. Its leave-one-out variant is known to produce an estimator of the generalization error which is almost unbiased. Its major drawback rests in its time requirement. To overcome thi...
متن کاملLS-SVM Hyperparameter Selection with a Nonparametric Noise Estimator
This paper presents a new method for the selection of the two hyperparameters of Least Squares Support Vector Machine (LS-SVM) approximators with Gaussian Kernels. The two hyperparameters are the width σ of the Gaussian kernels and the regularization parameter λ. For different values of σ, a Nonparametric Noise Estimator (NNE) is introduced to estimate the variance of the noise on the outputs. ...
متن کاملECT and LS-SVM Based Void Fraction Measurement of Oil-Gas Two-Phase Flow
A method based on Electrical Capacitance Tomography (ECT) and an improved Least Squares Support Vector Machine (LS-SVM) is proposed for void fraction measurement of oil-gas two-phase flow. In the modeling stage, to solve the two problems in LS-SVM, pruning skills are employed to make LS-SVM sparse and robust; then the Real-Coded Genetic Algorithm is introduced to solve the difficult problem...
متن کاملModel Selection for the l2-SVM by Following the Regularization Path
For a support vector machine, model selection consists in selecting the kernel function, the values of its parameters, and the amount of regularization. To set the value of the regularization parameter, one can minimize an appropriate objective function over the regularization path. A priori, this requires the availability of two elements: the objective function and an algorithm computing the r...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005